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Abstract — We study a wiretap channel model where 
the sender has M transmit antennas and there are two 
groups consisting of Ji and J2 receivers respectively. 
Each receiver has a single antenna. We consider two 
scenarios. First we consider the compound wiretap model 
— group 1 constitutes the set of legitimate receivers, all 
interested in a common message, whereas group 2 is the 
set of eavesdroppers. We establish new lower and upper 
bounds on the secure degrees of freedom. Our lower 
bound is based on the recently proposed real interference 
alignment scheme. The upper bound provides the first 
known example which illustrates that the pairwise upper 
bound used in earlier works is not tight. 

The second scenario we study is the compound private 
broadcast channel. Each group is interested in a message 
that must be protected from the other group. Upper and 
lower bounds on the degrees of freedom are developed by 
extending the results on the compound wiretap channel. 



I. Introduction 

Wyner's wiretap channel is an information theo- 
retic model for secure communications at the physical 
layer. In this model, there are three terminals — a 
sender, a receiver and an eavesdropper. A wiretap 
code simultaneously meets a reliability constraint with 
respect to the legitimate receiver and a secrecy con- 
straint with respect to the eavesdropper. In recent times, 
there has been a significant interest in applying this 
model to wireless communication systems. Some re- 
cent works include secure communications over fading 
channels [3|-[5], multi-antenna wiretap channels [6|- 
Ifl4l and several multiuser extensions of the wiretap 
channel. 

The wiretap channel requires that channel statistics 
of all the terminals be globally known. This model 
is justified in applications where the receiver channels 
are degraded. The wiretap code can be designed for 
the strongest (worst-case) eavesdropper in the class 
of all eavesdropper channels. However in many cases 
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of practical interest, such as in the case of multi- 
antenna channels, the receivers cannot be ordered in 
this fashion. There is no natural choice for the "worst- 
case" eavesdropper and the ordering of the eavesdrop- 
pers depends on the transmit directions. Hence it is 
natural to study an extension of the wiretap channel 
that explicitly incorporates the lack of knowledge 
of the receiver channels i.e., the compound wiretap 
channel. This model was recently studied in 0, lfT31 . 
IfTSl . The channels of the legitimate receiver and 
the eavesdropper take one of finitely many values. 
Note that this problem is equivalent to broadcasting a 
common message to multiple intended receivers, one 
corresponding to each channel state, while keeping the 
message secure against a collection of non-colluding 
eavesdroppers. A lower bound on the secrecy capacity 
is established in lfT31 . One special case where the 
optimality of this scheme holds is the deterministic 
wiretap channel with a single realization of the legiti- 
mate receiver. In this case the lower bound coincides 
with a natural pairwise upper bound on the secrecy 
capacity. The pairwise bound is obtained as follows. 
We consider the secrecy capacity associated with one 
particular pair of legitimate receiver and eavesdropper 
by ignoring the presence of all other terminals. Clearly 
this constitutes an upper bound on the capacity. The 
pairwise upper bound is obtained by selecting the pair 
with the smallest capacity. The pairwise upper bound 
was also used in establishing the secrecy capacity 
in 0, 0, lfl6l for a class of parallel reversely de- 
graded compound wiretap channels. In [3 1 the authors 
consider the case of multiple legitimate receivers and 
one eavesdropper and introduce a new class of secure 
multicast codes that achieve the pairwise upper bound. 
When specialized to the case of no eavesdroppers, 
the resulting scheme yields a different coding scheme 
than the vector codebook approach in [17|. The case 
when there is one legitimate receiver and multiple 
eavesdroppers is settled in 0, lfl6l . A new coding 
scheme is proposed that meets the pairwise upper 
bound. Some other recent works on the compound 
wiretap channel include |18|, |19|. 
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To the best of our knowledge, no upper bounds, 
besides the pairwise upper bound, are known for the 
compound wiretap channel. In this paper we study 
the multi-input-single-output (MISO) wiretap channel, 
where both the legitimate receivers and the eaves- 
droppers channel take one of finitely many states. We 
develop a new upper bound on secrecy-rate that is 
tighter than the pairwise upper bound and establishes 
that in general there is a loss in degrees of freedom 
due to uncertainty of channel state information at 
the transmitter. In addition we develop new lower 
bounds that combine the real interference alignment 
technique recently proposed in [20|-[23| with wiretap 
code constructions. Our achievable degrees of freedom 
remain constant, independent of the number of states of 
the legitimate receiver and eavesdropper. In contrast we 
observe that naive approaches based on time-sharing 
only achieve vanishing degrees of freedom as the 
number of states increase. 

We also study an extension of the compound MISO 
wiretap channel when there are two messages, that we 
refer to as the compound private broadcast. To our 
knowledge the private broadcast model is first proposed 
by Cai and Lam [24|. While |24| only studies the de- 
terministic broadcast channel, more recent works 1 10], 
ll25l study a larger class of channels including the dis- 
crete memoryless channels and the multi-input-multi- 
output Gaussian channels. The present paper extends 
this model to the case when each receiver's channel 
takes one of finitely many states. Lower and upper 
bounds on the sum of the secure degrees of freedom are 
developed. While we restrict our analysis to the above 
mentioned cases, we expect similar techniques to be 
applicable to other extensions of the wiretap channel 
such as H26) (27) El Ifl4l. 

The remainder of the paper is organized as follows. 
Section|II]described the channel model and summarizes 
the main results in this is paper. In section [HI] we 
review the real interference alignment scheme for the 
scalar point-to-point Gaussian channel. Sections [IV] 
and [V] establish lower and upper bound on the secrecy 
degrees of freedom of the compound wiretap channel. 
Sections [VI] and IVHI develop analogous results for the 
compound private broadcast channel. Conclusions are 
provided in section IVIIII 

II. Main Results 

The channel model consists of one transmitter with 
M antennas and two receivers each with one antenna. 
We further assume that the channels coefficient vectors 
of the two receivers belong of a finite set i.e., 

h£H = {h 1 ,h 2 ,...,h Jl } 

ge5 = {gi,g2, • ■ • ,g./ 2 } 

It is assumed that each receiver knows its own channel 
realization whereas the remaining terminals are only 
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aware of the sets H and Q. Furthermore we assume 
that the channel coefficients remain fixed for the entire 
duration of communication. In our analysis of lower 
and upper bounds we make one of the following two 
assumptions. 

Assumption 1: The channel vectors hi, ... , hj 1 as 
well as gi , . . . , gj 2 are each drawn from a real valued 
continuous distribution. 

Assumption 2: Any collection of M (or fewer vec- 
tors) in % U Q be linearly independent. 
We note that assumption [T] almost surely implies 
assumption [2] and in this sense it is stronger. The first 
assumption is used in the analysis of the lower bound 
whereas the second assumption is used in the analysis 
of the upper bound. 

The resulting channel model can be expressed as 

yj = hjx + vj, j = l,...,J 1 
zk = glx + w k , k = l,...,J 2 
where the channel input vector x is required to satisfy 
the average power constraint _E[||x|| 2 ] < P, the addi- 
tive noise variables Vj and Wk are i.i.d. and distributed 
Af(0,l). 

In the remainder of this section we separately con- 
sider two cases: the compound wiretap channel and the 
compound private broadcast channel. 

A. Compound Wiretap Channel 

A compound wiretap encoder maps a message m, 
uniformly distributed over a set of size 2 nR , to the 
channel input sequence x™. The decoder produces a 
message estimate fhj — gj{yf\ hj). A rate R is achiev- 
able if there exist a sequence of encoder and decoders 
of such that Pr(e) = Pr(m ^ fhj) — > as n — > 00 for 
each j = 1,2,..., J\ and — > for each 
j = 1,2,...,J2. The largest rate achievable under 
these constraints is the compound secrecy capacity. 
Of particular interest in this paper is the degrees of 
freedom (d.o.f.) of the compound wiretap channel. We 
say that d is an achievable secure degrees of freedom 
for the compound wiretap channel, if there exists a 
sequence of achievable rates R(P), indexed by power 
P, such that 

R(P) 



d 



lim 

P->oo 
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The maximum attainable value of d is the secrecy d.o.f. 
of the compound wiretap channel. 

We develop the following lower and upper bounds 
on the secure degrees of freedom. 

Theorem 1: Under assumption [T] the following se- 
cure degrees of freedom are achievable for the com- 
pound wiretap channel for all channel coefficient vec- 
tors, except a set of measure zero, 




min(Ji, J 2 ) < M, 
min(Ji, J 2 ) > M. 



(4) 
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Fig. 1. Interference Alignment for the compound wiretap channel. Each of the four messages is drawn from a PAM constellation and 
carries a rate m g log P. The linear precoder V guarantees that while each legitimate receiver can decode all the four messages, each 
eavesdropper can only obtain two integer linear combinations of the messages (and no other information about the messages), thus reducing 
its signal dimension by a factor of 2. Precoding matrices based on real interference alignment techniques [20], [21] enable us to reduce 
the signal dimension at an arbitrary number of eavesdroppers by a factor of s=s , thereby achieving 1 - degrees of freedom in 
Theorem [T] 
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The lower bound, for the case min(,/i,J 2 ) > M, 
is achieved by combining real-interference alignment 
with a wiretap code construction. We can interpret 
the resulting degrees of freedom as follows. By using 
interference alignment, the transmitter chooses sig- 
nalling dimensions such that at each eavesdropper, the 
received signal dimensions are reduced by a factor 
of approximately jj, whereas each intended receiver 
incurs no loss in the received signal dimensions. A 
wiretap code can then be designed to take advantage of 
this discrepancy to achieve 1 — -i degrees of freedom. 

It is noteworthy that interference alignment signifi- 
cantly outperforms a naive time-sharing based scheme 
where the achievable degrees of freedom approach zero 
as the number of states becomes large. 

Proposition 1: A scheme that combines time- 
sharing and noise transmission achieves the following 
degrees of feedom 



dl S 



M-l 



min( Ji, J2) ' 



min(Ji, J 2 ) < M 
min(Ji, J 2 ) > M 



(5) 



Comparing (0| and (0 it is clear that interference 
alignment provides significant gains in the degrees 
of freedom compared to time-sharing based lower 
bounds. The following example considers the case 
of rationally dependent channel gains and shows that 
higher achievable degrees of freedom can be achieved 
by a multilevel coding scheme. 

Proposition 2: Consider a special case of channel 
model ©, where M = J\ = J e = 2 and furthermore 



yi = *i + x 2 + 1/1 , 
z k = x k + w k , 



y 2 = xi - x 2 + v 2 



k = 1,2 



(6) 



corresponding to the choice of hi = [1; 1], h 2 = 
[1;— 1], gi = [1;0] and g 2 = [0;1], There exists a 
multi-level coding scheme that achieves log 3 2 w 0.63 
secure d.o.f. I 
As will become apparent, the proposed multi-level 
coding scheme bears similarity with the interference 
alignment technique in that both schemes force the 
eavesdropper receivers to decode linear combination of 
transmitted symbols. However while the interference 
alignment technique requires each legitimate receiver 
to decode every message symbol, the proposed multi- 
level coding scheme relaxes this constraint by taking 
advantage of the special channel structure in ©. 

The proof of Theorem [T] and Prop. [2] are provided 
in section [IV] The proof of Prop. Q] appears in Ap- 
pendix lAl 

Theorem 2: Under assumption [2] the following ex- 
pression provides an upper bound on the secure d.o.f. 
of the compound wiretap channel 



dij = 



1, 



min(Ji, J 2 ) < M 
rjrj+i , min( Ji, J 2 ) > M 



(7) 



M 2 -M+ 



A new upper bound is derived in the proof of 
Theorem [2] by considering the constraints imposed due 
to secrecy and common message transmission. As we 
show below, the single-letter upper bounds in earlier 
works only yield 1 d.o.f. In particular the pairwise 
upper bound on the secrecy capacity is 



C < maxmin/(x;yo|zfc) 

Px j,k 



(8) 
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This bound can be interpreted as follows: consider 
receiver j and eavesdropper k. An upper bound on 
the secrecy capacity, in absence of all other terminals, 
is 7(x;yj|zfe). Minimizing over all such pairs results 
in ([SJ. To the best of our knowledge this upper bound 
has been shown to be tight in some special cases 0, 
02), Ifl6l . For the compound MISO wiretap channel 
however this upper bound results in 1 secure d.o.f. 
Indeed with x ~ W(0, jjl) 

I(x;yi\zj) =I(x;yi,Zj) -I(x;Zj) 



2 



P 



1, / \i(H)P\ 1, / 
-^2 l0 H 1+ M )-2 l ° g V' M 

where \\{H) and A 2 (i7) are the two non-zero eigen- 

values of the matrix H — I l T I ( gj ). This 

yields 1 d.o.f. 

To improve the pairwise upper bound in (JHJ one can 
incorporate the fact that each receiver wants a common 
message i.e., 



C < maxminmin{/(x; yi|zj), J(x;yi)} 



(9) 



however it can easily be verified that this potentially 
tighter bound also yields 1 d.o.f. 

Instead of applying the single-letter bounds above in 
Theorem [2] we start with the multi-letter characteriza- 
tion and carefully combine the associated constraints 
to get the proposed upper bound. We sketch the main 
steps below. 

First, via the secrecy constraint, we show that 



nR < %i, . . . ,y M )--j7i(zi, 



,z M ) + ne n , (10) 



where one can interpret the first term as the re- 
ceived signal at an enhanced user who observed all 
(yij • • • i yM ) whereas the second term corresponds to 
the observation at an "average eavesdropper". Thus for 
the rate to be large, we need either the joint entropy 
of the eavesdropper observations (zi,...,zm) to be 
small or the joint entropy of the legitimate receivers 
(yi, ■ • ■ ,Vm) to be large. 

Next we show that the joint entropy of (zi, . . . , zm) 
cannot be too small compared to the joint entropy of 
(yi, . . . , Ya/)- Recall that with J x > M and J 2 > M, 
both (hi, . . . , hjvf) and (gi, . . . , gjvf) constitute a basis 
of M. M . Using this property we show that 

ft(zi,...,z M ) > h(yi,...,y M ) -nMd, (11) 

where d is a constant that does not depend on P. 
Combining ( TTOt and (fTTT i we can deduce that 

nR< (l- ^\ fi(yi,..., y M ) + nd 1 (12) 
where di = d + e n . 



It thus follows that for the rate R to be large, we the 
joint entropy of (yi, . . . , yjv/) must be large. However 
since a common message needs to be delivered to each 
of the receivers, the outputs need to be sufficiently 
correlated. In particular we show that 



M 



n{M -1)R<^ %;) - %x, . . .,y M ) + nMe n . 

i=l 

(13) 

Eq. (TT2l and (fT3l l illustrate the tension between the 
secrecy and common message transmission constraint. 
For (fT2l to be large we need the output sequences 
(yi, . . . ,yM) to be as independent as possible. How- 
ever the common message constraint penalizes such 
independence. Our upper bound in Theorem [2] exploits 
this tension. A complete proof appears in section [V] 

B. Compound Private Broadcast 

An encoder for the compound private broadcast 
channel maps a message pair (mi,iri2), distributed 
uniformly and independently over sets of size 2 nRl and 
2 nR2 respectively, to the channel input sequence x n . 
The decoders in group 1 produces a message estimate 
rh\j = gij(y^;hj) while the decoders in group 2 
produce a message estimate n?2fc = g2k(z%; g/c). A rate 
pair (Ri, R2) is achievable if there exist a sequence of 
encoder and decoders of such that Pr(e) = Pr({mi ^ 
^yl/ii u { m 2 7^ ^fclfcLx) -> as n ->■ 00 and 
i/(mi;z") ->■ and i/(m 2 ;y™) -)■ for each 
k = 1 , . . . , J2 and j = 1 , . . . , J\ . The set of all 
achievable rate pairs under these constraints constitutes 
the capacity region. 

Of particular interest is the sum secrecy degrees 
of freedom (d.o.f.). We say that d s is achievable 
if there exists a sequence of achievable rate pairs 
(R!(P),R 2 (P)), indexed by power P, such that 

R 1 (P)+R 2 (P) 



d s = Km 

P^oc 



(14) 



The maximum attainable value of d s is the sum-secrecy 
d.o.f. of the compound private broadcast channel. 

We develop the following lower and upper bounds 
on the sum-secrecy degrees of freedom. 

Theorem 3: Under assumption [T] almost surely, the 
following sum-secrecy degrees of freedom are achiev- 
able for the compound private broadcast channel 



, M-1 

' M ' 
o A/-1 
Z A/+1 ' 



max(Ji, J 2 ) < M 
max(Ji, J 2 ) > M > min(Ji, J 2 ) 
min(Ji, J 2 ) > M 

(15) 

The coding scheme, presented in section [Vll also com- 
bines wiretap codes with the interference alignment 
scheme. The following theorem provides an upper 
bound on the sum secrecy degrees of freedom 
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Theorem 4: Under assumption^ an upper bound on 
the sum secrecy degrees of freedom of the compound 
private broadcast channel is 



2: 

2M- 



M 
2 M 



max(Ji, J 2 ) < M 

min(Ji, J2) < M < max(Ji, J 2) 

min(Ji, J 2 ) > M. 

(16) 



M 



A proof provided in section [VlTI extends the techniques 
in the proof of Theorem [2] 

Remark 1: Throughout this paper we assume the 
channels to be real valued. However we do not expect 
the results to be different for complex valued coeffi- 
cients. In particular, the upper bounds in Theorem [2] 
and |4] immediately extend to the complex channel 
coefficients as they are developed using standard tech- 
niques. The lower bounds in Theorem \T\ and [3] are 
based on the real interference alignment scheme. Using 
its recent extension to complex channel coefficients 
sketched in ll22l . we expect similar results to hold for 
complex valued channel coefficients as well. 

III. Real Interference Alignment 

In this section we review the main results of real 
interference alignment from [20|, \2l\. For simplicity, 
we describe this scheme for a point-to-point scalar 
channel. 

y = x + z, (17) 

where the input satisfies a power constraint E[x 2 } < 
P and the additive noise z ~ Af(0,a 2 ) is Gaussian. 
Assume that the input symbols are drawn from a PAM 
constellation, 

Co = ao {-Qo, -Qo + 1, • • • , Qo ~ 1, Qo} • (18) 

Two quantities associated with this constellation are 
the minimum distance and the rate. In particular ao = 
dmin(Co) governs the error probability according to the 
relation 

/ n? \ 

(19) 



Pr(e) < exp --SL , 



while the rate is given by 



1 



R= -log(l + 2Q ). 



(20) 



Furthermore the choice of Qo an d «o must satisfy the 
average power constraint 

Qo a o 



E\x l 



12 



< P. 



(21) 



For an arbitrary e > 0, select, Qo = P 2 and ao 
Pi. Then, 



Pr(e) < exp < — 



pe 



R 



1 



logP (22) 



shows that the error probability can be made suffi- 
ciently small by selecting P large enough and further- 
more the rate is close to the Shannon limit. 

The idea behind real interference alignment is to 
have multiple PAM constellation symbols instead of a 
single constellation ( [T8l and thus convert the channel 
into a multi-input-single-output channel. In particular 
consider a constellation 

C = a{-Q,-Q + 1,...,Q-1,Q}. (23) 

and suppose a total of L points bi , . . . , are drawn 
independently from this constellation. The transmit 
vector is of the form 



x = a b = 



a\, . . . ,a L \ 



(24) 



where ai,...,«i are rationally independent constants 
(see def. []])■ 

As shown in Fig. |2j while the transmit constellation 
is given by C in d23b and consists of (2Q+1) points, the 
receiver constellation C r (ot) consists of all (2Q + \ ) M 
points specified in d24l i i.e., 



C r (a) = I x e 



3b e c 



M 



= a 2 b 



(25) 



In our subsequent discussion we drop the explicit 
dependence of C r on a. 

One key result in [20|, [21 1 is a minimum distance 
between points in C r that depends on the constellation 
parameters Q, a and L and holds for all vectors a, 
except a set of measure 0. 

Lemma 1 ( j |20l/ . 4271/ ): For any e > there exists 
a constant k F such that 



k F a 



(26) 



for all vectors a, except a set of measure zero. 

The second key observation in [20], [21] is that there 
is a one-to-one mapping between x and b in d24i i if a 
consists of rationally independent coefficients. 

Definition 1: We say that a\,...,atL are rationally 
independent real numbers if the equation Y^,i=i a i°i = 
has no solution in (ci, . . . , Cl) involving only ratio- 
nal numbers. 

Provided the vector a consists of only rationally 
indpendent numbers, given an element x G C r , the 
decoder can uniquely identify the vector of message 
symbols b. Hence the error probability is given by 

Pr(e) < exp I — ' } = exp 



8cr 2 Q 2 ( L - 1 + £ ) 
(27) 

where we have used the expression for d m j n stated 
in Lemma Q] Finally with an appropriate choice of 
Q and a, one can approach the Shannon limit while 
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Fig. 2. Constellations for the real interference alignment scheme. The transmitter constellations are shown on the left hand side. Each of 

the M points bi, , bfj are sampled independently from C = a{Q, . . . , Q}. The receiver constellation C r (a) consists of (2Q + 1) 

of the form x = a T h. The minimum distance in C r (a) is stated in Lemma^ 



guaranteeing an arbitrarily small error probability in 
the high SNR regime. 

Proposition 3: [20|, [21 1 Suppose that we select 

Q = pm j a =^^ i (28) 
\\a\\Q 

then we have that E[x 2 ] < P and furthermore for all 
values of a, except a set of measure zero, we have that 



Pr(e) < exp{-7?P £ } 



(29) 



where r\ > is a constant that depends on the channel 
coefficients a, but does not depend on P. 

Proof: To show that the power constraint is sat- 
isfied, note that since the elements of b are selected 
independently from C, we have that 



E[x 2 } = E 



L 



= 2^ a 

i=l 

< a 2 Q 2 \\a\\ 2 . 



(30) 



(31) 



(32) 



Thus the choice of a in (|28| ) guarantees that E[x 2 ] < 
P. 

Substituting the value of a in ( 1281 ) into ( |27] | we have 
that for all a, except a set of measure zero, 

f k * p 
Pr(e) < cxp < — - 



exp 
exp 



8<7 2 Q 2 ( i - 1 + £ )Q 2 ||a| 
k 2 P 

"&7 a Q a ( x '+ t 0||a|| 2 
k 2 P e 



Sa 2 \\a\\ 2 
= cxp{— r)P E } 

where we have used the relation 

k 2 



(33) 
(34) 



in d33l > and 



is a constant that does not depend on P. ■ 
Note that the overall rate that one can achieve with 
this multiplexed code, 



R= Llog(2Q + 1) > 



L{\ - e) 1 



logP, (35) 



V 



> 



L + e 2 

can be made arbitrarily close to \ log P by selecting s 
to be sufficiently small. 

While the approach of multiple constellation points 
does not provide any gains over using a single PAM 
constellation ( fTSl in the point-to-point case, the flexi- 
bility in choosing any vector a consisting of rationally 
independent elements, has been used in ll20l . ETTl to 
create interference alignment for the K— user inter- 
ference channel and in [22|, |23| for the compound 
broadcast channel. In this work we show that this 
approach can also provide significant gains for the 
compound wiretap channel. 

IV. Compound Wiretap Channel: Lower 
Bounds 

In this section we develop the lower bounds on the 
secure degrees of freedom for the compound wiretap 
channel. 

In subsections IIV-AI and IIV-BI we provide the proof 
of Theorem Q] for the case when min(Ji, J2) < M 
and min(Ji, J2) > M respectively. Subsection IIV-CI 
provides a proof of Prop. [2] 

For the proof of Theorem Q] our approach is to 
evaluate the following lower bound on the secrecy 
capacity for a specific input distribution. 

Proposition 4: lfT31l An achievable secrecy rate for 
the compound wiretap channel model (f2|i is 

R = max < min/(u;y.,) — max/(u; Zfe) > (36) 

{ j k J 

for a choice of random variables (u,x) such that u — > 
x — > (yi,Zk) is satisfied. 



7 



A. Proof of Theorem^ min(Ji, J 2 ) < M 

When either J\ < M or J 2 < M we achieve full 1 
d.o.f. through a combination of zero-forcing and noise 
transmission techniques. 

When J 2 < M i.e., when the number of eavesdrop- 
per states is less than M, we zero-force all the eaves- 
droppers and achieve a rate that scales as \ log P. In 
particular note that the matrix G = [gi, g2, • • • j gj 2 ] £ 
B>Mxj 2 has a rank equal to J 2 < M. Construct a 
matrix B 6 j£M-j 2 xM ^ w j tn or thogonal rows, such 
that B ■ G = 0. Furthermore, almost surely, each hj is 
linearly independent of the columns of G and hence 
Bhj j£ for j = 1, . . . , J2. The transmitted vector is 

x = P T m, 



(37) 



Al- 



ls a 



where the information vector m 
vector of i.i.d Gaussian symbols. Since any information 
transmitted along rows of B will not be seen by any 
eavesdropper, setting u = m and x in (l37b . we have 
that 



R = min/(m; yf) 



min — log 

3 2 



1 



^ll^-ll 2 
M J 



(38) 
(39) 



which scales as | log P as Bhj ^ for each j = 
l,2,...,Ji. 

Similarly when Ji < M, we achieve 1 d.o.f. by 
transmitting a noise signal in the common null space 
of the channel of legitimate receivers. While each 
intended receiver only observes a clean signal, each 
eavesdropper receives a superposition of signal and 
noise and its rate does not increase unboundedly with 
P. 

In particular, the matrix H = [hi , . . . , h j 1 } has a 
rank J x < M. Construct A G M. M ~ JlxM with orthog- 
onal rows that satisfy A ■ H = 0. Furthermore, almost 
surely, g 3 is linearly independent of the columns of H, 
and hence Agj ^ 0. Let the transmitted vector be, 



ts 



(40) 



where t is any unit norm vector such that hjt ^ for 
7 = 1,2,..., Ji, and s ~ 7V(0, Po) is the information 
bearing symbol, and n ~ A/"(0, PoIa/-Ji ) is a vector 
of noise symbols transmitted in the common null-space 
of user matrices and where Pq = -ft is selected to meet 
the transmit power constraint. Accordingly the received 
signals can be expressed as, 



hJxH 
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and 



g^X+ Wk, 



gits + glA T n + w k 



(41) 
(42) 

(43) 
(44) 



An achievable secrecy rate with u = s and x in ( f40b is 

(45) 



i? = min/(s;yj) — max/(s;z/ £ ) 

= minilog(l + P |hJ<| 2 ) 

3 2 



1 



max — log 1 -, 
k 2 & { l + Po||Ag fe || 2 



, (46) 



which scales like ^logP since ||^.gfe|| > for each 
k = 1, 2, . . . , J 2 and hjt > for j = 1, . . . , Ji. 

B. Proof of Theorem\l} min(Ji, J 2 ) > M 

To establish an achievable rate, we again evalu- 
ate d36b for a certain choice of input distributed given 
by the real interference alignment scheme in |20|, [21]. 

To describe this choice, we begin by defining a set 



J- J 2 M 

r = nnci««e{o,-^- 



1}^, (47) 



where denotes the channel gain between the i— th 
antenna and the fe— th eavesdropper. Each selection 
of the tuple {a kl } G {0, ...,N- \} J ^ M results in 
a different element of T and there are a total of 
L = N MJ2 elements in this set. In addition let, 



V = 











G R MxMi (48) 



be a matrix where v G M. L consists of all elements 
in the set T- Furthermore let b G R Mixl be a 
vector whose entries are sampled independently and 
uniformly from a PAM constellation 

C = a{-Q,-Q + 1,...,Q-1,Q}. (49) 

Our choice of parameters in (l36b is 

x = Vh, u = h. (50) 

We next state two lemmas, helpful in evaluat- 
ing ( 1361 

Lemma 2: The choice of transmit vector in ( 1501 
results in the following effective channels at the le- 
gitimate receivers and the eavesdroppers: 



v . h •> v 3 

z fe = g T Sfcb + w k 



where the elements of h, G 



vLM 



(51) 



are rationally 



independent for each j = 1 , . . . , J\ and the elements 
of g belong to the set 



A 




a kl G {0, . . . , N} 



(52) 



s 



and the matrices S k £ R ( - N+1 '> J2M xLM have entries 
that are either or 1 and each row has no more than 
M ones. 

Proof: With the choice of V in d48l i. from direct 
substitution, 



h 3 = [hjxv 1 



,h 



(53) 



Since the elements hji are rationally independent, the 
elments of v are rationally independent and indepen- 
dent of hji it follows that all the elements of hj are 
rationally independent. Similarly we have that 

z fc = gfcb+ w k , 



where 



Sk 



, fffeJWfV 



(54) 



(55) 



is a length ML vector whose elements belong to the 
set A in d52t , 

Since all elements of g^ belong to A and _4| = 
(N + \)- ,2M is, for sufficiently large N, smaller than 
MN 2 , it must that that the vector gfc has repeated 
elements. Thus we can also express 



gfc 



s T s k , 



(56) 



where g is a vector consisting of all the elements in A 



and Sk G 



(N+1) J2M xLM 



is a matrix for which every 



column has exactly one element that equals 1, and the 
remaining elements are zero. 

It remains to establish that each row in Sk cannot 
have more than M elements that equal 1. Consider row 
1 in Sk- If the elements in columns 1%, . . . , It equal 1 
then it follows that g\ = gk.h = ■ ■ ■ = gfc,i T - Thus to 
upper bound the number of ones in any given row, we 
count the number of elements in the vector gfc in (l55T l 
that can be identical. Since each element in v is distinct 
it follows that no two elements of the vector <7fc,:v T can 
be identical. Thus no more than M elements in gfc. can 
be identical, completing the claim. ■ 
The following lemma specifies the parameters of the 
PAM constellation d49b for the error probability at each 
legitimate receiver in the virtual channel (BTT l to be 
arbitrarily small. The proof closely follows the proof 
of Prop. [3] and is omitted. 

Lemma 3: Suppose that e > be an arbitrary 
constant and let -f 2 = , f ^ 1 — Select 



MJ2 teT t 



Pi 



(57) 



7" 



then we have that ||x|| 2 < P and for all channel 
vectors, except a set of measure zero, we have that 



Pr(e) < exp (-■qP e 



(58) 



where 77 is a constant that depends on the channel 
vector coefficients, but does not depend on P. 



To evaluate d36l >. we will compute the terms /(b; yj ) 
and I(h;Zk) separately. From ( l58l it follows via Fano's 
inequality that 

ff(b|x,) = l+Pr(e)/r(b) 

= 1 + Pr(e)LAflog(2Q + 1) 
= l + o P (l), 

where Op(l) denotes a function that goes to zero as 
F^oo. Thus we have that 

I(b; yj )=H(b)-H(b\ yj ) 

= LMlog(2Q + l)-l-o P (l) (59) 
> LM log Q - 1 - o P (l) 
= LM(l-e) p _ 1 _ (1) (6Q) 
2{LM + e) B V ' 

l-e)logP-l-o P (l), 



> 



(61) 



where d59l l follows from the fact that each element of 
the vector b is selected independently from C, and (l60l l 
follows by substituting the choice of Q in d57l i in 
Lemma [3] 

To upper bound the term I(b;zfc) we note that 
from ( BTT l it follows that Zk — > Skh — > b holds. Hence 



I(b;z k ) <I(b;S k b) 
= H(Skb) 

(JV+1) A/J 2 

< J2 H ({Skb}t) 

t=i 

< (N + i) Mj2 log(2MQ + 1) 

< (N + l) Mj2 {logg + log4Af} 
\MJ 2 I 1 - £ 



(62) 

(63) 
(64) 



= (N + iy 



l2(MLT7) l0gF + l0g4M 
(65) 



where ( 1621 follows from the fact that Skb is a deter- 
ministic function of b, while d63l from the fact that 
conditioning reduces the entropy and finally d64l i from 
the fact that each row of Sk has at-most M elements 
equal to 1 and the remaining elements equal to zero 
as stated in Lemma|2]and hence the support of (Sfcb)t 
is (-MQ, . . . , MQ) and (l65T l follows by substituting 
the value of Q in (l57l i. Observe that 

Ki = (N + l) Mj2 log4Af 

is a constant that does not depend on P and substituting 

L = N M.h 



I(b;z k ) < 



2M(1 



1 / 1\ MJ2 

-){ 1 + n) logP + Xl 



1 



2M(1 + e 



■(l + 0jv (l))logP + Xi, 



(66) 
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where ojv(1) is a term that goes to zero as N — > oo. 
Finally substituting ( loTb and ( l66l l in (l36l l we have that 

-ft 1 ... 

' ' :(1 + <*(!)) 



lim 



P^oo 1 log P 



l-2e 



M(l + e) 



(67) 



which can be made arbitrarily close to 1 — 1/M, by 
selecting N sufficiently large and e sufficiently close 
to zero. 

C. Proof of Prop. \2\ 

The achievabilty scheme in this example employs a 
multi-level coding scheme. We first propose a coding 
scheme for a linear deterministic channel over F3 and 
then extend it to the Gaussian case using multi-level 
coding. 

1 ) Coding over a deterministic channel: 
Proposition 5: Consider a linear deterministic chan- 
nel over F3 with two input symbols X\ and x 2 and with 
output symbols described as follows: 



y 1 =x l + x 2 
y 2 =x%- x 2 

Zi = X;, i= 1,2 



(68) 



where the addition and subtraction is defined over the 
group in F3. Then we can achieve a secrecy rate of 
R = 1 b/s for this channel. 

Proof: The key idea behind the proof is to enable 
the legitimate receivers to take advantage of the field 
F3 in decoding while we limit the observation of the 
eavesdroppers to binary valued symbols. The wiretap 
code is illustrated below: 



msg. 


(Xl,*2) 





(0,0), (1,1) 


1 


(0,1), (1,0) 



(69) 



When message bit needs to be transmitted the sender 
selects one of the two tuples (0,0) and (1, 1) at ran- 
dom and transmit the corresponding value of (xi,X2). 
Likewise when bit 1 needs to be transmitted one of 
the two tuples (0,1) and (1,0) will be transmitted. 
Note that when b = is transmitted yi 6 {0, 2} while 
y 2 = whereas when b = 1 we have that yi = 1 
and y 2 G {1,2}. It can be readily verified that each 
receiver is able to recover either message. Assuming 
that the messages are equally likely, it can also be 
readily verified that the message bit is independent of 
both Xi and x 2 and thus the secrecy condition with 
respect to each eavesdropper is satisfied. ■ 
2) Multilevel Coding Scheme: Fix integers T and 
M with the following properties: T is the smallest 
integer such that for a given e > 0, Pr(£ ) < e where 
£ denotes the error event 



£ 



vi, v 2 



max 

iG{l,2} 



> 3 



T-l 



(70) 



and M is the largest integer such that 3 2M < P/2. 
We construct a multi-level code with a rate of M — T 
information bits and error probability at-most e. 

Let the information bits be represented by the vector 
b = (b T , b M -x). For each i £ {T,...,M -1}, 
we map the bit bi G {0, 1} into symbols (xi(i), x 2 (i)) 
according to the code construction in (1691 1. The trans- 
mitted symbols are given by 



M-l 

E 

l=T 



Xi (l)3 l , 



i = 1,2 



(71) 



and the received symbols at the two receivers can be 
expressed as, 



M-l 
l=T 



M-l 



v 2 



(72) 



(73) 



where we have introduced 

yx(l) = x 1 (l) + x 2 (l) G {0,1,2}, 
y 2 (l) = Xl (l) - x 2 (l) G {-1,0,1}. 

With the choice of M, it follows that -f^ [ 1 1 x 1 1 2 ] < P. 
Furthermore in the analysis of decoding, we declare 
an error if max^ > 3 T_1 . Conditioned on £ c , note 
that 

y t -y t mod3 T - 1 (74) 
y t (l) 3 l ) mod 3 T - v 1 mod 3 T (75) 



/M-l 



M-l 



y» - n = E y*® 3 

l=T 

have 



where we 

>M-1 - 



used 



(76) 



the fact that 
^Yld^r 1 Vi(f) 3 ( j mod 3 T = since each term 
in the summation is an integer multiple of 3 T . 

Thus by computing (l74i i it is possible to retrieve 
Tidier y~i{l) 3' (assuming the error event does not 
happen). Since there is no carry over across levels 
we in turn retrieve (^j(T), . . . , y~i(M)) at each re- 
ceiver. Then applying the same decoding scheme as 
in Prop. [5] at each level, each receiver can recover the 
underlying bits (br, ■ ■ ■ , bja)- If however we have that 
I Vi I > 3 T ~\ then the above analysis leading to d76l l 
fails and an error is declared. Since T is selected to be 
sufficiently large, this event happens with a probability 
that is less than e. 

In order to complete the analysis it remains to 
show that H(h\zi) = M — T. We first enhance each 
eavesdropper by removing the noise variable in 
i.e., Zj = Xj for j — 1,2. Now consider 

H(b T ,...,b M \zi) 
=H(b T ,...,b M \x i {T),...,x i {M)) 



M 

E 

l=T 



H(bi\ Xi (l)) = M-T, 
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where the last relation follows from H(bi\xi(l)) = 1 
since we use the code construction in d69l ) in mapping 
h -)• {xi(l),x 2 {l)). 

The resulting d.o.f. achieved by the multi-level code 
is given by 



R 



\\ogP 

M -T 
l/2(2Mlog 2 3 + l) 
log 3 2 + o M (l), 



(77) 

(78) 
(79) 



where om(1) — > as M — > oo. 

V. Compound Wiretap Channel: Upper 
Bound 

In this section provide a proof of Theorem[2] We use 
the convenient notation where the transmit vectors and 
received symbols are concatenated together i.e., X = 
[x(l), . . . ,x(n)] and likewise yj = [yj(l), . . . ,Yj{n)\, 
Zfc = [zfc(l), . . . ,Zfe(n)] etc. In this notation the chan- 
nel can be expressed as 



'31 



gJX + w fe , 



J = 1, ■ 
k = 1, 



,J 2 



(80) 



Note that it suffices to consider the case when 
min(Ji, J2) > M in Theorem [2] Otherwise the upper 
bound equals 1, which continues to hold even in 
absence of secrecy constraints. 

Secondly we will assume that J\ = J2 = M in 
deriving the upper bound. In all other cases, it is clear 
that the upper bound continues to hold as we only 
reduce the number of states. 

For any code there exists a sequence e n that ap- 
proaches zero as n —> 00 such that 

-I(m;z k ) <e n , fc = 1,2, . . . , M (81) 
n 

^H(m\ yj ) < e n , j = l,2,...,M. (82) 

where dSTT l is a consequence of the secrecy constraint 
whereas (f82t is a consequence of Fano's inequality 
applied to receiver j — 1, 2, . . . , J r . 

The proof is rather long and hence divided into the 
following subsections. 

Upper bound from secrecy constraint: 

Lemma 4: The rate of any compound wiretap code 
is upper bounded by the following expression: 

nR < h(yi,.. . ,y M ) - fi(zfc) + nc k , (83) 

where c k is a constant that does not depend on P. 
The proof of Lemma |4] follows by considering the 
secrecy constriaint between each receiver and eaves- 
dropper. A proof is provided in Appendix [B] 



Using d83l in Lemma [4] for each eavesdropper k = 
1, 2, . . . , M and adding up the resulting upper bounds 
we get that 

1 M 

nR < h(y 1 , . . .,y M ) - TJ^ H z k) + nc n , (84) 

fc=i 

< h(yx,...,y M ) - ^fi(zi,...,z M ) +nc , 

(85) 

< (l - j-^J h(yi, y M ) + nd + nc , (86) 

where cq — 4r X^fcLi c fe anc l ^ are constants that do 
not depend on P. Here ( l85l l follows from the fact 
that conditioning reduced differential entropy and ( l86l l 
follows from 

ft(zi, . . . , z M ) > fi(yi, ■ • ■ , Ym) - nMd, (87) 

where d is a constant that does not depend on P as 
shown in Appendix ICl 

Upper bound from multicast constraint: We ob- 
tain the following upper bound on the joint entropy 

%i, ■ • ■ j )/m ) 

Lemma 5: 

M 
i=l 

(88) 

Proof: Our upper bound derivation uses the fact 
that the same message must be delivered to all the 
receivers and hence the output at the M receivers must 
be sufficiently correlated. Note that 

ft(yi) ■ • ■ ,Ym) = fi(yi,-.-,yM|m) + /(m;yi,...,y M ) 

< fi(yi,-.-,yAf|m) + H(m) 

= h(y 1 ,...,y M \m) + nR (89) 

M 

<^%j|m)+ni? (90) 



M 

< V h(yj) - MH(m)+ nMs n + nR 



3=1 

M 

< E h{yj) - (M - l)nR + nMe n (91) 
i=i 

where d89b and d9Tb follow from the fact that since 
the message is uniformly distributed over the set of 
size 2 nR , it follows that H{m) = nR while d90j) is 
a consequence of the fact that conditioning reduces 
differential entropy. ■ 
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Combining secrecy and multicast constraints: In the 
final step we combine ( l86b and ( l88l l. In particular, 
multipying both sides of ( f86l > by M we get, with 

d = d + c , 

MnR = (M - l)%i, . . . , y M ) + nMd 

(M 
%j) - (M -l)nR+ nMe n 

+ nMd (92) 

M 

<(M-i)J2Kyo) 

- (M - l) 2 nR + nM(d + (M - l)e„) (93) 
Rearranging the terms in d93l ), we have that, 

nR(M + (M - l) 2 ) 

M 

< (M -l)Y, %i) + nM(do + (Af - l)e„) 
i=i 

(94) 

An upper bound for h(yj) provided in Appendix iDl 
(ref. (12061 ) gives that 

(95) 



nR(M + (M - l) 2 ) 

< (M - 1) i ^ ^ max(log P, 0) + nd 1 
[i=i 

+ nM(d + (M - l)e„) 
= (M - max(log P, 0) 



(96) 



+ nM(do + (Af-l)e„ + (M-l)di) (97) 

Thus with d 2 = M(d + (M - l)e n + (M - l)d x ), a 
constant that does not depend on P we have that 

R< J^Ld^P.o)^ (98) 



M +(M - l) 2 V2 

which yields the desired upper bound on the degrees 
of freedom as stated in Theorem [2] 

VI. Compound Private Broadcast: Lower 
Bounds 

In this section we provide a proof for Theorem [3] 
When max(Ji, J2) < M the transmitter achieves 
two degrees of freedom by zero-forcing the undesired 
groups. In particular, it finds two vectors vi and V2 
such that hjv2 = and g^vi = for j = 1, . . . , J\ 
and k = 1, . . . , J2. By transmitting x = vjmi +V2m2, 
the effective channels at the two groups are given by 



yj = hjvirni + v.j 



(99) 



Furthermore since, almost surely hjvi / and 
gfc v 2 7^ 0, it follows that one degree of freedom is 
achievable for each of the two groups. 



To establish the degrees of freedom in the remain- 
ing two cases in Theorem [3] we combine the real 
interference alignment scheme with wiretap coding. 
In particular we evaluate the following single-letter 
acheivable rate-pair for specific choice of auxiliary 
random variables that result from the real-interference 
alignment scheme. 

Proposition 6: An achievable rate for the private 
memoryless broadcast channel p yit ...,yj ltZl ,...,zj is 
as follows: 



Pi = min/(ui;y,) - maxIYui; z fe , u 2 ) 

j k 

R 2 = minl(u 2 ;z k ) - max7(u 2 ;y_y, ui), 

k j 



(100) 



where (1/1,1/2) are mutually independent random vari- 
ables. The joint distribution satisfies the Markov con- 
dition 



(ui, u 2 ) 



(101) 



and E[x 2 } < P. 

The proof of Prop. [6] is presented in Appendix [E] 

Case min(Ji,J2) < M < m&x(Ji,J 2 ): We as- 
sume without loss of generality that Ji > M > J 2 . Let 



Vi be a vector such that g^. vi = for k 



and furthermore hjvi ^ for j - 
transmit vector x is given by 

x = vimi + V2b 2 



1,. 



1,...,J 2 
, Ji. The 



(102) 



where the precoding matrix V 2 and information sym- 
bols mi and h 2 are selected based on the real in- 
terference alignement scheme as described below. Let 
N 2 6 N be a sufficiently large integer and define 



M Ji 

t=i j=i 

M Ji 

i=ij=i 



< Pa < N 2 - 1 } (103) 



< pji < N 2 } (104) 



consisting of L 2 = N^ IJl and L' 2 = (N 2 + l) MJl 
elements respectively. Let V2 G R L2Xl be a vector 
consisting of all elements in T 2 and let 



Vo 







»MxML 2 



(105) 



The elements b 2 i, . . . ,b 



2{ML 2 ] 



of the information vec- 



tor b 2 e R ML2 for group 2 in ( 1102b are sampled inde- 
pendently and uniformly from the PAM constellation 
of the form 



C = a{-Q,-Q + 1,...,Q-1,Q} 



(106) 
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while the information symbol for group 1 is of the 
form 

611 

mi = a T bi = [ ai ... a.{M-i)L 2 } ■ 

&l(Af-l)£ a 

(107)' 

where the elements ctj are selected to be rationally in- 
dependent of all other coefficients and their monomials 
and the symbols in bi are also sampled independently 
and uniformly from the PAM constellation ( 1106b . 

Substituting the choice of x in ( 1102b the channel 
model reduces to 



yj = (hjv 1 )a J b 1 +hjy 2 b 2 



z fe = gfc V 2 b 2 



(108) 



Following the same line of reasoning as in the proof of 
Lemma[2] our choice of x in ( 1102b reduces the channel 
model as stated below. 

Lemma 6: With choice of x in ( 1102b the output 
symbols at the receivers can be expressed as 



Zk 



bfbi + h T T,b 



j 

gfc b 2 



3 2 



(109) 



where h e R i2 is a vector consisting of all the 
elements in A 2 , (cf ( 1104b ). and the entries of vec- 
tors hj and g^ are rationally independent and also 
independent of elements in A 2 . The entries of matrix 



oL-xML 



2 are either or 1 and there are no more 



than M ones in each row of Tj. 

The following Lemma can be established along the 

lines of Prop. [3] 

Lemma 7: Suppose that e > be an arbitrary 
constant and let j 2 = — „ =tct=ttf^ — - be a 



normalizing constant that does not depend on P. If 
we select 



Q = 



a = 7- 



l-e 

P\ 2((M-l)L 2 +L' 2 +e) 



I P \ 2 

>2M ) 



(HO) 



Q 



then we have that ||x|| 2 < P and for all channel 
vectors, except a set of measure zero, we have that 



Pr(e) < cxp {-r]P E ) . 



(Ill) 



where 77 is a constant that depends on the channel 
vector coefficients, but does not depend on P. 

The achievable rate pair (Ri,R 2 ) is obtained by 
evaluating ( 1100b in Prop. [6] with u\ = bi, u 2 = h 2 



and with x in ( 11021 ). 

i?i = min/(bi;yj) — max/(bi; Zk, h 2 ) 

j k 

= min/(bi;yj) 

'= ff(bi) -maxi?(bi|yj) 

3 

= ^0-0^(1) 

(M-1)L 2 

= J2 H(b u )-o P {\) 

i=l 

= (M-l)L 2 log(2Q + l)-op(l) 
> {M-l)L 2 \og{Q)-o P {l) 

= (A/ - 1)L S ' ~ : 



2((Af - l)L a + £3 + e) 



logP 



(112) 

(113) 
(114) 
(115) 

0P (1) 
(116) 



where dl 121) follows from the fact that (b2,Zfc) are 
independent of bi in ( 1109b , and dl 13b follows from 
Fano's inequality via ( 11371 ), and ( 11 141 ) and dl 151 ) follow 
from the fact that the entries of bi are selected 
independently and uniformly from the constellation C 
in ( 1 106b and finally dl 16b follows by substituting the 
expression for Q in dl 10b . 



R 2 = min/(b 2 ;zfc) - max/(b 2 ; y 3 ;, bi) 

fe j 

> min/(b 2 ;z fc ) - max J(b 2 ;Tjb 2 ) (117) 

k 3 

> H(b 2 ) - max#(b 2 |z fe ) - maxH(Tjb 2 ) (118) 



fe 3 
> H(b 2 ) - o P (l) - maxif(Tjb 2 ) 



(119) 



ML 2 log(2Q+l) -op(l) -maxi/^ba) 



(120) 



£ 2 



> ML 2 log(2Q + 1) - op(1) - max > H{{T 3 b 2 } 



k=l 



(121) 



where dl 17b follows from the fact that since b 2 and bi 
are indpendent, we have the Markov chain (b 2 , Zk) — > 
Tjbx bi for z k in ( fT09b . and ( fTT9l follows from 
Fano's inequality via (1137b . and ( 1120b follows from 
the fact that the entries of b 2 are i.i.d. and uniformly 
distributed over C in ( 1106b , and (1121b follows from the 
fact that conditioning reduces entropy. 

We further simplify the last term in (1121b as follows: 

H({T 3 b 2 } k ) > L' 2 log(2MQ + 1) (122) 
>£ 2 log(2Q + l)+4logM (123) 

( 1122b from the fact that as stated in Lemma [6] each 
row of the matrix Tj has no more than M ones and 
thus the support of each element {Tjb 2 }fe is contained 
in {-MQ, MQ}. Substiuting ( fT23l into (Q2D and 
defining K — op(l) + i 2 logAf, a constant that does 
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not depend on P, we have that 

R 2 > (ML 2 - L' 2 ) log(2Q + 1) - K 

> (ML 2 - L' 2 )\ogQ - K 

> (ML 2 -L' 2 )- 



(124) 



1 



2((M - 1)L 2 + L 2 + e] 



logP-K 
(125) 

where the last term follows by substituting the expres- 
sion for Q in d 1 10b . Using d 1 16b and ( 1125b we have 
that 

i?l + R 2 



lim 

P-s-oo 



ilogP 



(1-8) 



(1 



(A/ - l)L 2 + ML 2 - L' 2 
(M - l)L 2 + L' 2 + e 

2M- I - (1 + ^ 



MJi 



(M - 1) + (l + + 



(126) 



(127) 



A'.;' 



N* IJ1 and L' 2 = 



where we have substituted L 2 = N 2 IJl 
(N 2 + l) MJl in the last expression. Finally note that 
the expression ( 1127b can be made arbitrarily close 
to 2 1 by choosig N 2 sufficiently large and e 
sufficiently close to zero. 

Case min(Ji, J 2 ) > M: When min(Ji, J 2 ) > M, 
we need to do signal alignment to both groups of users. 
Let J = max(Ji, J 2 ). We design our scheme assuming 
Ji = J 2 = J. Clearly this coding scheme can also be 
used in the original case. We define 



71 = 



T 2 = 




A 2 



M ,1 

1111'/' 

i=l j=l 

M J 

II IPC 



l<otji<N} (128) 



1 < an < N } (129) 



1< an < N + 1 > (130) 



1 < au < N + l } (131) 



where the sets 71 and T 2 consist of L = N MJ elements 
whereas the sets Ai and A 2 consist of L' = (N+1) MJ 
elements . Let vi , v 2 G M. L x 1 be vectors consisting of 
all elements in 71 and T 2 respectively and let 



v 





T 
h 







k = 1,2 (132) 



be the precoding matrices and let the transmit vector 
be expressed as 



x = Vibi + V 2 b 2 , 



(133) 



where the vectors bi,t>2 G R Mi consist of infor- 
mation symbols for group 1 and 2 respectively. Each 
entry in these vectors is sampled independently and 
uniformly from the PAM constellation of the form 

C = a{-Q,...,Q}. (134) 

Following the line of reasoning in Lemma [2] and 
Lemma [6] we have the following. 

Lemma 8: With the choice of x in d 1 33b we can 
express the resulting channel output symbols at each 
receiver as follows, 



Yj = hjbi -i- ii l jU2 t v i 
z k = g^b 2 + g T 5 fe b 2 

where the vectors h, g G K L consist of all elements 
belonging to the sets A 2 and A\ respectively. The 
elements of vector hj are rationally independent and 
independent of the the elements of A\ and likewise 
the elements of g& are rationally independent and 
independent of the elements of A 2 . The matrices 
Tj,S k G R L ' xMi have elements that take values 
of either or 1 and there are no more than M 
elements whose value equals 1 in any given row of 
these matrices. 

The choice of parameters a and Q stated below can be 
derived along the lines of Prop. [3] 

Lemma 9: Suppose that e > be an arbitrary con- 
be a normalizing 



h 1 T,b 2 



(135) 



stant and let 7 = ^-^ ?sxt* 

2—t t £ To ^— ^ t 



t£Ti 



constant that does not depend on P. If we select 



2(ML + i'+e) 



' P 1 

y2M I 



(136) 



Q 



then we have that ||x|| < P and for all channel 
vectors, except a set of measure zero, we have that 



Pr(e) < exp (-rjP e ) , 



(137) 



where ?y is a constant that depends on the channel 
vector coefficients, but does not depend on P. 
Finally to compute the achievable rate pair we substi- 
tute in ( 1 100b . Ui — bi, u 2 — h 2 and x as specified 
in ( 1133b . Following analogous calculations that lead 
to (1125b we have that 



Ri > 
Ri > 



(ML - L')(l - e) 

ML + L' + e 
(ML -£')(! -e) 



K 



(138) 
(139) 



ML + V + e 
where K is a constant that does not depend on P 
Substituting L = N MJ and V = (N + 1) MJ , 

,MJ 



lim 



Ri + R 2 



P^OO il0gP 



= 2(l-e) 



M+(l + ±) MJ -r^ 



(140) 
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which can be made arbitrarily close to 2^-^ by 
selecting N sufficiently large and e sufficiently close 
to zero. 

VII. Compound Private Broadcast: Upper 
Bounds 

When max(Ji, J 2 ) < M, the stated upper bound is 
2. It holds even when J\ = J2 = 1. 

When min(Ji, J 2) < M < max(Ji, J2) we assume 
without loss of generality that J\ < J2. The upper 
bound is developed assuming J-y = 1 and J2 = 
M. Any sequence of codes that achieves a rate-pair 
(Ri,R 2 ) satisfies, via Fano's inequality, 

-if(mi|yi) < e n ,-H(m 2 \z k ) < e n ,k= 1,...,M, 
n n 

(141) 

and the secrecy constraints 

-I(m 2 ;yx) < e n , -I(mi\z k ) < e n ,k = 1,...,M, 
n n 

(142) 

We can upper bound the sum-rate of the messages as: 
n(Ri + R 2 ) < I (mi, m 2 ;yi,z 1 , . . . ,z M ) + ne n 

= h(zi, . . . ,z M ) + ft(yi|zi, . . . ,z M ) 

- h(y 1 ,z 1 , . . . ,z M \mi, m 2 ) + ne n (143) 

Since the channel vectors gi , . . . , gu are linearly 
independent, we can express 

M 

hi = A fc gfc 
fe=i 



and it follows from (1141b that 



and hence 



H(yi\zi,...,z M ) < h ^yi-^A^ (144) 

/ M \ 

= h I vi - AiWj = nKi 



(145) 



where K\ is a constant that does not depend on P. We 
also have that 

H(yi,zi,...,z M \mi,m 2 ) (146) 
> ft(yi,zi, . . . ,z M \mi, m 2 , X) (147) 
= h(vi, wi, . . . , w M ) = nK 2 , (148) 

where i^2 is a constant that does not depend on P. 
From ( 11431 ) with K 3 = Ki — K 2 + e n , we have that 

n(Ri+R 2 ) < H(zi,...,z M )+nK 3 . (149) 

Since message 2 needs to be delivered to M re- 
ceivers, we have from Lemma |5j that 



(M - l)nR 2 < ) j h(zi) - h(zi, . . . , z M ) + ns n , 

(150) 



nRi < I(m 2 ;yi) 

= ft(yi) - 7j(yi|m 2 ) 

= h(yi)+K i (151) 

Combining (11491 1. ( 1150b and ( 1151b we have that 

M 

nM(Ri + R 2 )<J2 + ( M - + 7lif 5' 

i=l 

(152) 

where ^5 = (M — 1)K4 + K3 is a constant that 
does not depend on P. Using the upper bound in 
Appendix [D] on the entropy of received vector we have 
that 

nM(Ri + R 2 ) < (2M - 1)- max (logP, 0) + nK 6 , 

(153) 

and hence, 



Ri + R 2 2M - 1 



lim — 



M 



(154) 



as required. 

In the final case when min(Ji,J2) > M, we 
develop the upper bound assuming that J\ = J 2 = M. 
The upper bound continues to hold when Ji > M and 
J 2 > M as we are only reducing the number of states. 
For any private broadcast code, there exists a sequence 
e n such that 

-H(mi |z fc ) < e n , -I(mr,z k ) < e n (155) 

n n 

It follows via (l83l in Lemma |4] that 

nRi < H(yi, . . . ,y M ) - h(z k ) + nc k , (156) 

where c k is a constant that does not depend on P. 
Similarly applying Fano's Inequality 



1 



H(m 2 \z k ) < e r 



(157) 



for message m 2 we can establish along the lines of 
Lemma [5] that 



A I 



H(zi, ...,Z M )<J2 h ^ - n ( M - 1 ) i?2 + Mn£n 
i=l 

(158) 

Furthermore, using ( T87T ) we have that for a constant d 
that does not depend on P, we have that 

h(y ll ...,y M ) < K(zi,...,z M ) + nMd (159) 

M 

< V h(zi) - n(M - l)R 2 + Mne n + nMd, 
i=i 

(160) 
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where the last relation follows by substituting d 158b . 



Combining ( 1 1 56b and ( 1 160b and rearranging, we have 
that 

nR 1 +n(M-l)R 2 (161) 

M 

< h(zj) + nMd + nci + Mne n (162) 

i=2 

Ti 

< (M - 1)— max (logP, 0) + nK, (163) 

where nK = n(M— l)di+nMd+Mne n is a constant 
that does not depend on P. Note that the last relation 
follows by the upper bound on the entropy of each 
received vector as derived in Appendix [D] Using a 
symmetric argument it follows that 

Ti 

nR 2 + n(M - l)i?i < (M - 1)- max (logP, 0) + nK, . 



on reconfigurable antennas 
wiretap channel model. 



2811 for the compound 



Combining ( 1163b and ( 1164b . we have that 



lim < 2- 



P->oo ±logP 



(164) 



(165) 



Appendix A 
Proof of Prop. Q] 

It suffices to consider the case when min(Ji, J 2 ) > 
M, since the other case is covered in Theorem Q] We 
separately show how to attain M j~^ 1 and A j" 1 degrees 
of freedom. 

A. Attaining degrees of freedom 

Our coding scheme is described as follows. 

1) Let T = (j/lj) denote all possible subsets of 
users of size M — 1. We label these subsets as 
Si, ... , St- Note that each user belongs to Tq = 

(m-I) su t> sets - 

2) Let n be a sufficiently large integer. A message 

m consists of nToRo information bits where 



as required. 



VIII. Conclusions 



This paper develops new upper and lower bounds 
on the degrees of freedom of the compound wiretap 
channel. The upper bound is developed through a new 
technique that captures the tension between the secrecy 
and common message constraints and strictly improves 
the pairwise upper bound. A lower bound, that achieves 
non-vanishing degrees of freedom for arbitrary number 
of receiver states, is established based on the real 
interference alignment technique. These techniques are 
extended to a related problem: the private broadcast 
channel and again new upper and lower bounds on the 
degrees of freedom are established. 

Our results suggest that interference alignment can 
potentially play a significant role in designing robust 
physical layer secrecy protocols. This technique pro- 
vides the mechanism to reduce the number of dimen- 
sions occupied by an interfering signal at a receiver, 
thus increasing the number dimensions that are avail- 
able for the signal of interest. We apply this technique 
to reduce the observed signal dimensions at multiple 
eavesdroppers, thus significantly enhancing the rates 
achieved for the compound wiretap channel compared 
to traditional techniques. Nevertheless, we illustrate 
by an example that unlike the K— user interference 
channel ll20l and the compound MIMO broadcast 
channel 11221 . 11231 . a direct application of interference 
alignment cannot achieve the secrecy capacity of the 
compound wiretap channel. In terms of future work it 
will be interesting to close the gap between the upper 
and lower bounds. Another promising direction is to 
investigate recent ideas on practical techniques based 



Ra = ^logP-e, 



(166) 



and where 6 is a sufficiently large constant, 
(which will be specified later) that does not 
grow with P. The message is mapped into 
a codeword of a (T, To) erasure code C i.e., 
to — > (m\,m 2 , . . . , tot) where each symbol m-i 
consists of nRo information bits. Each receiver 
retrieves the message to provided it observes any 
To symbols. Furthermore as established in Q 
suitable wiretap code constructions exist such 
that provided each of the T symbols are indi- 
vidually protected, the overall message remains 
protected, i.e., 

I{m t ;z%) <ne n , Vt=l,...,T 

=>■ I{m;z r k l ) <Tne n (167) 



The overall rate R 



To 



R results in the 



following degrees of freedom: 



T 

M 



\M-2) 

(m-i) 



h 

as required. 

It remains to show how to transmit message m t 
such that each user in a subset St decodes it with 
high probability while satisfying I(m t ;z£) < 
ne n . 

3) Each subset St is served over n channel uses. 
The message m t is transmitted to M — 1 users 
belonging to this subset along the lines of The- 
orem Q] when Ji < M i.e., by transmitting 
information symbols in the common range space 
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and noise in the common null space of these 
users (c.f. (l40b). 



in this selected set. Let b* be a vector such that 



X, 



u f s + a t n, 



(168) 



where a t and u t are unit norm vectors such that 
hf u t 7^ and hf a t = for each i G St and s 
and n are information bearing and noise symbols 
respectively. 

Following the analysis leading to d46*i > we can 
see that the following rate is achievable: 

-logP- 



Rt 



i 



min -log |hfu t | 2 - 



(169) 



max — log 

k 2 



|g^u t | 2 
|a^g fc | 2 



where O* is a constant that does not scale with 



P. Furthermore we let 6 in (1166ll to be 



e 



max 0(. 

t 



(170) 



4) With the choice of rate in ( 1166b every user in 
each subset St can decode the message m t with 
high probability. Each user will have access to 
To elements of the codeword (mi, . . . , raj) and 
hence recover the original message m. Further- 
more each individual message is protected from 
each eavesdropper 

I(m t ;z%) <ne n (171) 

and hence from ( 1167b it follows that J(m; zj™ ) < 
nTe n . Since e n can be made sufficiently small, 
the secrecy condition is satisfied. 



B. Attaining 



M-l 



degrees of freedom 



sub- 



Our coding scheme is described as follows. 

1) We considers all possible T e = (ji/lj 
sets of M — 1 eavesdroppers and label them 
as S\ , . . . , S\e . Note that each eavesdropper 
belongs to a total of Tf = (j^Zl) subsets. 

2) Consider a parallel noise-less wiretap channel 
consisting of T e links, where each link supports 
a rate nR\, where 



Ri 



1 



\ogP-n 



(172) 



and fl is a sufficiently large constant that will 
be specified later. Each eavesdropper is absent 
on a total of Tf links while each legitimate 
receiver observes all the T e links. Following the 
scheme in we can transmit a message m 
of rate nRiT[ by mapping the message m — > 
(mi, . . . , mye). The symbol mt, consists of nRi 
bits and forms the input message on channel k. 
3) For each choice of Sf, we transmit information 
in the common null-space of the eavesdroppers 



for each j G <S 2 and transmit 



x t = b t s, 



where s is the information bearing symbol. Since 
each vector is linearly independent of any 
collection of M— 1 eavesdropper channel vectors 
it follows that hfb t ^ 0, and one can achieve a 
rate 



Ri = 2 log 



min I hfb t 1 2 P 
te{i,...,T"} 

i&{l,...,Jx} 

> ^logP-0, 



(173) 



where 



n = 



min — log |hf b( | 2 . 



te{i,...,T e } 2 
ie{i,...,Ji} 



(174) 



With this choice of Q, each receiver decodes each 
of the messages mi, . . . , my with high probabil- 
ity. Furthermore, each of the eavesdropper does 
not have access to T\ sub-messages correspond- 
ing to the subsets St to which it belongs. By 
virtue of our code construction, this ensures that 
J(m;z^) < ne n . 

The overall achievable rate is given by R = 

rpe 

jtsRi and hence the achievable degrees of free- 
dom are given by 



rpe 



(m-i) 



J-2 



as required. 



Appendix B 
Proof of Lemma|4] 



From the secrecy constraint and Fano's inequality 
(c.f. (|8TT ) and d82b ) we have that for any length n code 
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with rate R: 



have that 



nR = H(m) < H(m\yx) + I(m; yi) 
</(m;yi)+ne„ (175) 
</(m;yi) - I(m;z k ) + 2ns n (176) 

< I(m; yi, y 2 , . . . , y M -i, z fe ) - 7(m; z fe ) + 2ne„ 

< 7(m;yi, . . . ,y A/ _i|z fe ) + 2ne n 

= %i, ■ • .,yAf-i|zfc)- 

■ • -,yM-i|zfc, m) + 2ne„ 

< %i, ■ ■ - ,yM-i|zfe)- 

fi(yi, ■ ■ -,yM-i|zfe,X, m) + 2ne„ 

= %i, • ■ - ,yAf-i|zfe)- 

fi(vi, . . . , v M _i) + 2ne„ (177) 
= ft(yi, . . . , y M -i, Zfe) - fi(z fe )- 
n(M - 1) 



■ log(27re) + 2ne„ 



(178) 



%i, • • • , ym, Zfe) - ft-(yAf|yi, ■ • ■ , yM-i, z fc ) 

, n(M-l), ,„ , „ 
- ft(zfc) - i log(27re) + 2ne n 

%i,---,Ym) -^(zfe) 

- %M|yi, ■ • . ,y M -i, Zfe) + fi(zfc|yi, . . ., y M ) 

n(M - 1) 



2ne 



■ log(27re) 



(179) 



where (11751 ) and (11761 ) are consequences of Fano's 
Lemma ( f82t and the secrecy constraint (IHTT l respec- 
tively, ( 11771 ) follows from the fact that the noise 
variables (vi, . . . , vm—i) m <f8Qb are independent of 
(x, zk) and finally ( 1178b follows from the fact that the 
noise variables are i.i.d. Af(0, 1). 

To complete the argument it suffices to show that 
there exist constants dik and d 2 k, that are independent 
of P such that 



KyM\yi, ■ • • ,yj\/-i,Zfc) > ndik 

S(zfe|yi,...,y M ) < nd 2 k- 
To establish (11801) we observe that 



ft(zfe|y!,..., 
/ 

= h z k - 



< % Zfc - 




(183) 



yi, ■ • • ,yj\/ 



Wfe - b fc 



log27re (1 + ||b fc 



2\ A 



nd 2 k 



(184) 
(185) 



where we use ( 1182b in ( 11841 ) and the last relation 
follows from the fact that the noise vectors consist of 
independent Gaussian entries Af(0, 1). 
Thus we have from (11791) that 



nR < h(yi, . . . ,y M ) ~ K z k) + nc k , 



(186) 



where 



c k = 2e„ + y log27re + ilog27re(l + ||b fe || 2 ) (187) 
is a constant that does not depend on P. 



Appendix C 
Proof of d87b 

Define the channel matrices 



(180) 
(181) 



%Af|yi,-.-,yM-i,2fe) > %M|yi, • • .,y M -i,2 k ,X) 

= ^(v M |yi, ...,y M -i,Zfe,X) 

= - log 27re = ndik 

where the last relation follows from the fact that the 
noise variable mm is independent of all other variables. 
To establish (11811) we observe that the collection of 





- hi - 




r t i 
K 


H = 




G = 










T 



(188) 



and the noise matrices 





W| 




Vl 


w = 




v = 













(189) 



vectors (hi, . . . , h/^) constitutes a basis for R M i.e., 



so that we can express 

yi 



we can express 



gfe — -Hfcbfc 



(182) 



yM 



= HX + V, 



zi 



= GX + W. 

(190) 



where H k = [hi, h 2 , . . . , h M ] G K MxAf is a matrix 
obtained by stacking the channel vectors of the M 
legitmate receivers, bfe G M. M is a vector. Hence we 



Then (1571 ) is equivalent to showing that, 

h{GX + W)> h(HX + V) - nMd, (191) 
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for some constant d that does not depend on P. 

h(GX + W) 

= h(HX + V) - h(HX + V\GX + W) 

+ h(GX + W\HX + V) 
> h(HX + V) - h(HX + V\GX + W) 

+ h(GX + W\HX + V, X) (192) 

= h(HX + V) - h{HX + V\GX + W) + h(W) 

(193) 

Ti 

= h(HX + V) — h(HX + V\GX + W) + - log 27re 

(194) 

where in (1192b we use the fact that conditioning 
reduces the differential entropy, in J 193b and (11941 ), we 
use the fact that noise variables in W are independent 
of V and i.i.d. 7V(0, 1). 
Further note that 

h(HX + V\GX + W) 

= h(V - BG- X W\GX + W) (195) 
< h(V - HG^W) 

\og2Tredet {I + HG- l G- T H T ), (196) 



Pt > tia.ce(K x (t)) exceeds the sum of the eigen values 
and hence exceeds the largest eigen value. 



n 

= £-log2^e (PtWh^ + l) 

t=i 

<^log27re^||h j || 2 i^P t + lj (203) 



(201) 
(202) 



<-log27re(||h,|| 2 P + l) 



(204) 



n 
2 



where we use the fact that the channel matrices H 



and G are full rank and invertible in (1195b and that 
they have i.i.d. 7V(0, 1) entries in (11961 ). Substituting 
in ( 11941 ) it follows that 



h{GX + W) > h(HX + V) 



logdet (I + HG- 1 G- T H T ^ 



(197) 



and thus we can select 

d= ^M l0gd6t ( X + HG ~ lG ~ THT ) ■ 

in d87>. 

Appendix D 
Bound on h(yj) 

Define the input covariance at time t, K x (t) = 
E[x(t)x(t) T ] and let P t = tvace(K x (t)). Recall from 
the power constraint that — Y^t=i Pt — P- Since 



y j (t)=hfx(t) + v j (t) 



we have that 



var(x,-(t)) =hjK x (t)h J +1 



(198) 



< A max (if x (t))||h,|| 2 + 1 (199) 



<P t ||h,- 



1 



(200) 



where ( 1198b follows from the fact the noise vari- 
able Vj is indpendent of the input x(t), ( 1199b from 
the variational characterization of eigen values (see 
e.g., (29)) and finally (1200b follows from the fact that 



< | max (log P, 0) + ^ log 27re(l + ||h,- 1 1 2 ) 

(205) 



n 
2 



where ( 1201b follows from the fact that conditioning 
reduces the differential entropy, ( 12021 ) from the fact 
that a Gaussian random variable maximizes the differ- 
ential entropy among all random variables with a fixed 
variance and ( 12031 ) follows from Jensen's inequality, 
since the log(-) function is concave and ( 1204b follows 
from the power constraint. To get an upper bound on 
a ll 1 < j < M we have that 



%j) < 2 max ( lo S P ' °) + " d i ( 206 ) 



where 



di = — log 27re(l + max ||h 



(207) 



l<j<M 

Appendix E 
Proof of Prop. [6] 

For any joint distribution of the form 

Put ,U2,x,yx,... ,yjj ,z\ ,z.j 2 

Pu 1 Pu2Px\u 1 ,U2Pyi,...,y.j 1 ,z 1 ,...,zj 2 |x- (208) 

we show that the following rate pair is achievable 

Rx = mmI( Ul -y 3 ) - I( Ul ; u 2l z* k ) ~ 5 (209) 

j 

R 2 = mml(u 2 ;z k ) - I(u 2 ; t/i,y*) - S, (210) 

k J 

where 6 > is an arbitrary constant and where we 
have introduced, 

k* = argmaxIYui; u 2 ,z k ), j* = argmax/(zv 2 ; ux,yA. 

k j 

We start by constructing codebooks 

d = |«f o6 :a = l,...,2 nR \b= l,...,2 n/ ( Ui;U3 ^)} 

C 2 = [v% ab : a = 1, . . . , 2 nR - ,6 = 1,..., 2 nI ^ u ^\ 

(211) 

We assume that the codewords in C\ belong to the 
set T™(ui) of strongly typical sequences whereas the 
codewords in C 2 belong to the set T™(u 2 ). Given mes- 
sages mi and m 2 the encoder sets a\ = rr>\, a 2 = m 2 
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and selects b x , uniformly from {1, . . . , 2 nI ( ul ' U2 
and 6 2 uniformly from the set {1, . . . , 2 nI( - U2 ' Ul ' y i >}. It 
selects codewords (u?„ h and uS„ h ) from Ci and 
C2 respectively and then transmits x n generated by 
passing codewords through the memoryless, fictitious 
channel p x \ UltU2 (-). 



from the conditioning. We separately bound the two 
terms in (1218ll. 



-H{ mi \z^)>-H{ mi \z^,u^) 
n n 

>iff(u?,,m|z&, !#)-*„ 

n 

= -H(u?\z^,uS)-S n 
n 

= -H(u?\u2) - -J«; z£K) - £„ (218) 



(215) 
(216) 
(217) 



where ( 12151 l follows from the fact that condition- 
ing on u 2 reduces the entropy, ( 1216b follows from 
via (12121 i. (I217l i follows from the fact that mi is a 
deterministic function of u™ and hence can be dropped 



n n 



min I(ux;yj*) - S, 

(219) 



With the choice of R\ and R 2 specified in ( 1209b 
and (121 Oi l it can be shown, (see e.g., [25 1), that there 
exist codebooks C\ and C 2 in (121 lb such that the error 
probability at each receiver is smaller than any target 
value. Furthermore receiver k* in group 2 can decode 
the index 61 with high probability if it is revealed mi 
in addition to (z£*, 1/%). Similarly eavesdropper j* can 
decode the index 62 if it is revealed m2 in addition to 

max(iff(^|z^, u 2 \ mi), iff(i/j|yji, u?, m 2 ) j <s n 

(212) 

For such a codebook, we show that for some sequence 
e n that approaches zero as n — > 00, we have that 

-/(m i; z£) < e„, -I(m 2 ;y?) < £ n (213) 
n n J 

for fc = 1, . . . , J2 and j = 1, . . . , J\, We first observe 
that it suffices for us to show that 

-I(mr,z%*)<5 n , -I(m 2 ;y£)<5 n . (214) 
n n 

As we show below, one can provide sufficient side 
information to enhance each eavesdropper so that it is 
equivalent to the strongest eavesdropper. Then it is easy 
to verify that if the coding scheme guarantees ( 1214b 
then the messages are also secure from the enhanced 
eavesdroppers and hence the original eavesdroppers. 

Lemma 10: For each k — 1, . . . , J2 there exists a 
variable that satisfies (ui, 1/2) — > x — > (zk,Zk*) —> 
z k such that u 2 , z k *) = J(ui; u 2 ,z k .~z k ). Like- 

wise for each j = 1, . . . , Jj there exists a variable 
that satisfies (1/1,02) — ► x — > (y^, y 3 *) — > y, such that 
7(u 2 ; ui,y/*) = I(u 2 ; u 1 ,y :j ,y :J ). 
The proof of Lemma [TOl will be provided at the end of 
this section. To establish ( 1214b consider: 



where we have used the fact that the codeword u™ is 
independently selected of t/J m our construction and is 
uniformly distributed over the set C\. We upper bound 



the second term in ( 1218b as follows. Since the cascade 
channel (ui, u 2 ) — > z k * is memoryless, it an be easily 
verified that 

n 

I(u?;z&\u2) <Y,I(u u ;z kH \u 2i ) (220) 



Furthermore for each codebook in the ensemble of 
typical codebooks we have from the weak law of large 
numbers that the summation on the right hand side 
converges to nl(u\\ z k * \u 2 ) i.e., the mutual informa- 
tion evaluated with the original input distribution. Thus 
we can write 

7«;z£K) <nI(u V ,z k *\u 2 )-no n (l), (221) 

where o„(l) converges to zero as n — > 00. Substitut- 
ing ( |219b and (1221b into (1218b we establish the first half 
of ( 1214b . The second half of (1214b can be established 
in an analogous manner. 

It remains to provide a proof of Lemma [10] which 
we do below. 

Lemma 170} The construction of random variable 
Zfc follows the same approach as in the case of com- 
pound wiretap channel 1151 . In particular suppose that 
Ik £ {k, k*} is a random variable independent of all 
other variables. Let Pr(Ik — k*) = p. 

Define a new random variable, zj k = (zi k ,Ik) 
and consider the function f(p) — I{u\\ u 2 , z k , zj k ). 
It is clear that f(0) = I(m; u 2 ,z k ) < u 2 , z k * ) 

whereas /(l) = I(ux\ u 2 , z k , z k *) > I(ur, u 2 ,z k * ). 
Thus there exists a value of p* e [0, 1] such that 

I(ui; u 2 ,z k ,z Ik ) = I(ui; u 2 ,z k *) 

and the resulting random variable in Lemma [10] is 
given by z k = (zj k ,I k ). The construction of y k follows 
in an analogous manner. ■ 
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